Compressed Particle-Based Federated Bayesian Learning and Unlearning

نویسندگان

چکیده

Conventional frequentist federated learning (FL) schemes are known to yield overconfident decisions. Bayesian FL addresses this issue by allowing agents process and exchange uncertainty information encoded in distributions over the model parameters. However, comes at cost of a larger per-iteration communication overhead. This letter investigates whether can still provide advantages terms calibration when constraining bandwidth. We present compressed particle-based protocols for “unlearning” that apply quantization sparsification across multiple particles. The experimental results confirm benefits robust bandwidth constraints.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Unlearning Arist0telian Physics: A Study of Kn0wledge-Based Learning*

A study of a group of e lementary school students learning to control a computerimplemented Newtonian object reveals a surprisingly uniform and detai led collection of strategies, at the core of which is a robust "Aristotel ian" expectation that things should move in the direction they are last pushed. A protocol of an undergraduate dealing with the same situation shows a large overlap with the...

متن کامل

Particle Swarm Optimisation for learning Bayesian Networks

Specifically, we detail two methods which adopt the search and score approach to BN learning. The two algorithms are similar in that they both use PSO as the search algorithm, and the K2 metric to score the resulting network. The difference lies in the way networks are constructed. The CONstruct And Repair (CONAR) algorithm generates structures, validates, and repairs if required, and the REstr...

متن کامل

DisTriB: Distributed Trust Management Model Based on Gossip Learning and Bayesian Networks in Collaborative Computing Systems

The interactions among peers in Peer-to-Peer systems as a distributed collaborative system are based on asynchronous and unreliable communications. Trust is an essential and facilitating component in these interactions specially in such uncertain environments. Various attacks are possible due to large-scale nature and openness of these systems that affects the trust. Peers has not enough inform...

متن کامل

Bayesian Compressed Regression

As an alternative to variable selection or shrinkage in high dimensional regression, we propose to randomly compress the predictors prior to analysis. This dramatically reduces storage and computational bottlenecks, performing well when the predictors can be projected to a low dimensional linear subspace with minimal loss of information about the response. As opposed to existing Bayesian dimens...

متن کامل

Robust Bayesian Compressed sensing

We consider the problem of robust compressed sensing whose objective is to recover a high-dimensional sparse signal from compressed measurements corrupted by outliers. A new sparse Bayesian learning method is developed for robust compressed sensing. The basic idea of the proposed method is to identify and remove the outliers from sparse signal recovery. To automatically identify the outliers, w...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Communications Letters

سال: 2023

ISSN: ['1558-2558', '1089-7798', '2373-7891']

DOI: https://doi.org/10.1109/lcomm.2022.3223655